Image processing system, imaging device and method, recording medium, and program

ABSTRACT

The present invention relates to an image processing system, a device and a method for image pickup, a recording medium, and a program that make it possible to transfer a large amount of image data to another apparatus efficiently. A digital camera  1  transfers image data to a server  5  after transferring thumbnail image data yet to be transferred to the server  5.  When new thumbnail image data is generated during the transfer of the image data, the transfer of the image data is stopped, and the new thumbnail image data is transferred first. Obtaining the thumbnail image data, the server  5  displays the thumbnail images on a display, receives a request for the transfer of image data from a user, and then supplies the request to the digital camera  1.  The digital camera  1  transfers the image data to the server  5  on the basis of the request. The present invention is applicable to digital still cameras.

TECHNICAL FIELD

The present invention relates to an image processing system, a deviceand a method for image pickup, a recording medium, and a program, andparticularly to an image processing system, a device and a method forimage pickup, a recording medium, and a program that make it possible totransfer a large amount of image data to another apparatus efficiently.

BACKGROUND ART

Recently, with the spread of digital still cameras, functionality ofdigital still cameras has been expanded by for example providing acommunication function to digital still cameras in addition to anoriginal image pickup function and a recording function, and thus usesof picked-up image data have been expanded.

For example, a digital still camera is devised which has a communicationfunction, and leaves a reduced image when transmitting a main imagerecorded on a recording medium to another communication apparatus sothat a user can easily refer to the transferred image. (See for exampleJapanese Patent Laid-Open No. 2002-16865 (pages 6 to 10, and FIG. 2 andFIG. 3).)

Such a digital still camera enables effective use of storage capacity ofthe recording medium provided in the digital still camera because imagedata is supplied to another communication apparatus and stored in thecommunication apparatus, and also facilitates reference of transferredimages on the digital still camera side.

However, in the above-described method, when image data obtained bypicking up an image is transferred to another communication apparatus tobe used by a side of the other communication apparatus, a user of theother communication apparatus cannot refer to the image until thetransfer of the image data is completed.

Recent digital still cameras have higher functionality and also have anexpanded storage area of a recording medium for recording image dataobtained by image pickup, so that the digital still cameras can store alarge amount of image data. Thus, for example, when all of the largeamount of image data is to be transferred, a great amount of processingtime, which increases as free space of the recording medium is reduced,is required.

In many cases, however, the communication apparatus side to which thelarge amount of image data is thus transferred actually uses a part ofthe image data to process and print images.

When a digital still camera is used in business as for example by anewspaper publishing company, in particular, only a small number ofimages are selected for actual use with an article or the like from alarge amount of images obtained by image pickup, and most of the imagesare discarded.

In such a case, it is desirable to be able to use images obtained byimage pickup immediately. With the above-described method, however, theimages cannot be referred to until transfer of a large amount of imagedata is completed, so that efficiency of business can be decreased.

On the other hand, a method of reducing an amount of data to betransferred by selecting images to be transferred on a digital stillcamera side is conceivable. This, however, involves complicatedoperation by a user of the digital still camera, thus rendering imagepickup operation inefficient.

DISCLOSURE OF INVENTION

The present invention has been made in view of the above, and it is anobject of the present invention to make it possible to transfer a largeamount of image data to another apparatus easily and efficiently.

According to the present invention, there is provided a first imageprocessing system characterized by including: an image pickup device fortransferring image data obtained by picking up an image of a subject;and an image processing apparatus for obtaining the image datatransferred from the image pickup device; wherein the image pickupdevice includes: image pickup means for picking up the image of thesubject and generating the image data; generating means for generatingrepresentative image data representing the image data generated by theimage pickup means; and supplying means for supplying the representativeimage data preferentially before the image data in supplying the imagedata and the representative image data to the image processing apparatusconnected via a network; and the image processing apparatus includes:obtaining means for obtaining the representative image data and theimage data supplied from the image pickup device; displaying means fordisplaying the representative image data obtained by the obtainingmeans; and storing means for storing the representative image data andthe image data obtained by the obtaining means in association with eachother.

According to the present invention, there is provided a second imageprocessing system characterized by including: an image pickup device fortransferring image data obtained by picking up an image of a subject; animage managing apparatus for managing the image data transferred fromthe image pickup device; and an image processing apparatus for obtainingthe image data managed by the image managing apparatus; wherein theimage pickup device includes: image pickup means for picking up theimage of the subject and generating the image data; generating means forgenerating representative image data representing the image datagenerated by the image pickup means; and first supplying means forsupplying the representative image data preferentially before the imagedata in supplying the image data and the representative image data tothe image managing apparatus connected via a network; the image managingapparatus includes: first obtaining means for obtaining therepresentative image data and the image data supplied from the imagepickup device; managing means for managing the representative image dataand the image data obtained by the first obtaining means in associationwith each other; and second supplying means for supplying therepresentative image data preferentially before the image data insupplying the image data and the representative image data to the imageprocessing apparatus connected via the network; and the image processingapparatus includes: second obtaining means for obtaining therepresentative image data and the image data supplied from the imagemanaging apparatus; displaying means for displaying the representativeimage data obtained by the second obtaining means; and storing means forstoring the representative image data and the image data obtained by thesecond obtaining means in association with each other.

According to the present invention, there is provided an image pickupdevice characterized by including: image pickup means for picking up animage of a subject and generating image data; generating means forgenerating representative image data representing the image datagenerated by the image pickup means; and supplying means for supplyingthe representative image data preferentially before the image data insupplying the image data and the representative image data to anotherapparatus connected via a network.

When the image pickup means generates new image data while the supplyingmeans is supplying the image data to the other apparatus, the supplyingmeans can preferentially supply new representative image datarepresenting the new image data, the new representative image data beinggenerated by the generating means, to the other apparatus before theimage data being supplied.

The image pickup device further includes receiving means for receivingcontrol information on supply of the image data, wherein the supplyingmeans can supply the image data to the other apparatus on a basis of thecontrol information received by the receiving means.

The supplying means can supply related information on the image data tothe other apparatus together with the representative image data or thenew representative image data.

The image pickup device further includes: receiving means for receivinga first cryptographic key supplied by the other apparatus; cryptographickey generating means for generating a second cryptographic key forencrypting the image data generated by the image pickup means; firstencrypting means for generating first encrypted data by encrypting theimage data generated by the image pickup means by the secondcryptographic key; and second encrypting means for generating secondencrypted data by encrypting the second cryptographic key by the firstcryptographic key; wherein the related information on the image data canbe the second encrypted data.

According to the present invention, there is provided an image pickupmethod characterized by including: a first generating step forgenerating image data obtained by picking up an image of a subject; asecond generating step for generating representative image datarepresenting the image data generated by a process of the firstgenerating step; and a supply controlling step for controlling supply soas to supply the representative image data preferentially before theimage data in supplying the image data and the representative image datato another apparatus connected via a network.

When new image data is generated by the process of the first generatingstep while the image data is being supplied to the other apparatus, thesupply controlling step can control the supply so as to preferentiallysupply new representative image data representing the new image data,the new representative image data being generated by a process of thesecond generating step, to the other apparatus before the image databeing supplied.

The image pickup method further includes a reception controlling stepfor controlling reception of control information on supply of the imagedata, wherein the supply controlling step can control the supply so asto supply the image data to the other apparatus on a basis of thecontrol information received by a process of the reception controllingstep.

The supply controlling step can control the supply so as to supplyrelated information on the image data to an image processing apparatustogether with the representative image data or the new representativeimage data.

The image pickup method further includes: a reception controlling stepfor controlling reception of a first cryptographic key supplied by theother apparatus; a cryptographic key generating step for generating asecond cryptographic key for encrypting the image data generated by theprocess of the first generating step; a first encrypting step forgenerating first encrypted data by encrypting the image data generatedby the process of the first generating step by the second cryptographickey; and a second encrypting step for generating second encrypted databy encrypting the second cryptographic key by the first cryptographickey; wherein the related information on the image data can be the secondencrypted data.

According to the present invention, there is provided a program on arecording medium, the program characterized by including: a firstgenerating step for generating image data obtained by picking up animage of a subject; a second generating step for generatingrepresentative image data representing the image data generated by aprocess of the first generating step; and a supply controlling step forcontrolling supply so as to supply the representative image datapreferentially before the image data in supplying the image data and therepresentative image data to another apparatus connected via a network.

According to the present invention, there is provided a programcharacterized by making a computer perform: a first generating step forgenerating image data obtained by picking up an image of a subject; asecond generating step for generating representative image datarepresenting the image data generated by a process of the firstgenerating step; and a supply controlling step for controlling supply soas to supply the representative image data preferentially before theimage data in supplying the image data and the representative image datato another apparatus connected via a network.

The first image processing system according to the present inventionincludes: an image pickup device for transferring image data obtained bypicking up an image of a subject; and an image processing apparatus forobtaining the image data transferred from the image pickup device;wherein the image pickup device picks up the image of the subject andgenerates the image data, generates representative image datarepresenting the generated image data, and supplies the representativeimage data preferentially before the image data in supplying the imagedata and the representative image data to the image processing apparatusconnected via a network; and the image processing apparatus obtains therepresentative image data and the image data supplied from the imagepickup device, displays the obtained representative image data, andstores the representative image data and the image data in associationwith each other.

The second image processing system according to the present inventionincludes: an image pickup device for transferring image data obtained bypicking up an image of a subject; an image managing apparatus formanaging the image data transferred from the image pickup device; and animage processing apparatus for obtaining the image data managed by theimage managing apparatus; wherein the image pickup device picks up theimage of the subject and generates the image data, generatesrepresentative image data representing the generated image data, andsupplies the representative image data preferentially before the imagedata in supplying the image data and the representative image data tothe image managing apparatus connected via a network; the image managingapparatus obtains the representative image data and the image datasupplied from the image pickup device, manages the representative imagedata and the image data obtained in association with each other, andsupplies the representative image data preferentially before the imagedata in supplying the image data and the representative image data tothe image processing apparatus connected via the network; and the imageprocessing apparatus obtains the representative image data and the imagedata supplied from the image managing apparatus, displays therepresentative image data obtained, and stores the representative imagedata and the image data obtained in association with each other.

The image pickup device and method and the program according to thepresent invention pick up an image of a subject and generate image data,generate representative image data representing the generated imagedata, and supply the representative image data preferentially before theimage data in supplying the image data and the representative image datato another apparatus connected via a network.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing an example of fundamental configuration ofan image data transfer system to which the present invention is applied;

FIG. 2A is a perspective view of an example of external appearance of adigital camera in FIG. 1;

FIG. 2B is a perspective view of an example of external appearance ofthe digital camera in FIG. 1;

FIG. 3 is a block diagram showing an example of internal configurationof the digital still camera in FIG. 1;

FIG. 4 is a block diagram showing a detailed example of configuration ofa radio communication unit in FIG. 3;

FIG. 5 is a block diagram showing an example of internal configurationof a server in FIG. 1;

FIG. 6 is a block diagram showing an example of internal configurationof a personal computer in FIG. 1;

FIG. 7 is a flowchart of assistance in explaining an image transferprocess by the digital camera;

FIG. 8 is a flowchart of assistance in explaining details of an imagepickup process performed in step S7 in FIG. 7;

FIG. 9 is a flowchart of assistance in explaining details of a thumbnailimage data transmission process performed in step S3 in FIG. 7;

FIG. 10 is a flowchart of assistance in explaining an image datatransmission process performed in step S5 in FIG. 7;

FIG. 11 is a flowchart of assistance in explaining a request receptionprocess by the digital camera;

FIG. 12 is a flowchart of assistance in explaining an image datareception process by the server;

FIG. 13A is a schematic diagram showing an example of a GUI screendisplayed on a display of the server;

FIG. 13B is a schematic diagram showing the example of the GUI screendisplayed on the display of the server;

FIG. 14A is a schematic diagram showing another example of the GUIscreen displayed on the display of the server;

FIG. 14B is a schematic diagram showing the other example of the GUIscreen displayed on the display of the server;

FIG. 15A is a schematic diagram showing a further example of the GUIscreen displayed on the display of the server;

FIG. 15B is a schematic diagram showing the further example of the GUIscreen displayed on the display of the server;

FIG. 16 is a schematic diagram showing the further example of the GUIscreen displayed on the display of the server;

FIG. 17A is a schematic diagram showing an example of a format of JPEGimage data;

FIG. 17B is a schematic diagram showing the example of the format ofJPEG image data;

FIG. 18 is a schematic diagram showing a further example of the GUIscreen displayed on the display of the server;

FIG. 19 is a timing chart of assistance in explaining a flow of aprocess of transferring image data encrypted by a first encryptionsystem in the image processing system of FIG. 1;

FIG. 20 is a timing chart of assistance in explaining a flow of aprocess of transferring image data encrypted by a second encryptionsystem in the image processing system of FIG. 1;

FIG. 21 is a diagram showing another example of configuration of theimage data transfer system to which the present invention is applied;

FIG. 22 is a timing chart of assistance in explaining a flow of an imagedata transmission process in the image processing system shown in FIG.21 next;

FIG. 23 is a diagram showing a further example of configuration of theimage data transfer system to which the present invention is applied;and

FIG. 24 is a diagram showing a further example of configuration of theimage data transfer system to which the present invention is applied.

BEST MODE FOR CARRYING OUT THE INVENTION

FIG. 1 is a diagram showing an example of fundamental configuration ofan image data transfer system to which the present invention is applied.

A digital camera 1 in FIG. 1 has a radio communication function. Thedigital camera 1 is thereby connected continuously to a network 3typified by the Internet via a base station 2. The network 3 is alsoconnected with a server 5 installed in a company 4, which serverprocesses image data.

The server 5 is connected with a database 6 controlled by the server 5and storing image data. The server 5 is also connected with a network 7typified by a LAN (Local Area Network) or the like established in thecompany 4. The server 5 is thereby accessed by personal computers 8 and9 similarly connected to the network 7.

Thus, the server 5 and the personal computers 8 and 9 can obtain and useimage data stored in the database 6. The network 7 installed in thecompany 4 generally has a sufficiently broad band, so that the personalcomputers 8 and 9 can instantly obtain and use image data stored in thedatabase 6.

The digital camera 1 records image data obtained by picking up an imageof a subject on a recording medium. At this time, the digital camera 1generates thumbnail image data corresponding to a thumbnail image as areduced image of the obtained image.

Then, in a state of being capable of communication, the digital camera 1first transfers thumbnail image data not transferred yet to the server 5preset as an image data transfer destination via the base station 2 andthe network 3.

Transferring all thumbnail image data, the digital camera 1 nexttransfers image data recorded on the recording medium to the server 5preset as a transfer destination, as in the case of the thumbnail imagedata.

It is to be noted that the transfer of thumbnail image data takespriority over the transfer of image data. Specifically, when an imagepickup process is performed and new thumbnail image data is generatedduring the transfer of image data, the transfer of the image data isstopped, and the newly generated thumbnail image data is transferredfirst. When there is thereafter no thumbnail image data yet to betransferred, the transfer of the image data is resumed.

The server 5 displays a thumbnail image corresponding to thumbnail imagedata obtained from the digital camera 1 on a display using a GUI(Graphical User Interface) or the like. When the personal computer 8 or9 connected to the server 5 via the network 7 requests the thumbnailimage data from the server 5, the server 5 supplies the thumbnail imagedata obtained from the digital camera 1 to the personal computer 8 or 9on the basis of the request to display the corresponding thumbnail imageon a display of the personal computer 8 or 9 using a GUI or the like.

When image data is transferred from the digital camera 1, the server 5stores the obtained image data in the database 6 in association with thepreviously transferred thumbnail image data. As described above, theimage data stored in the database 6 can be used by the server 5 and thepersonal computers 8 and 9.

When a user of the server 5 referring to displayed thumbnail imagesselects a thumbnail image corresponding to image data desired to beused, the server 5 requests the digital camera 1 to transfer the imagedata corresponding to the thumbnail image.

When a user of the personal computer 8 or 9 displaying thumbnail imageson the display similarly selects a thumbnail image, the information issupplied to the server 5. Then, the server 5 receiving the informationrequests the digital camera 1 to transfer the thumbnail image data asdescribed above.

Obtaining the request to transfer the image data, the digital camera 1transfers the requested image data to the server 5 first before otherimage data. At normal times, image data recorded on the recording mediumis transferred to the server 5 in predetermined order. When, the requestis obtained, however, the digital camera 1 transfers the requested imagedata to the server 5 first irrespective of the order.

By transferring image data as described above, even in a case where alarge amount of image data is transferred, a user on the company 4 sidecan refer to thumbnail images even when the transfer of the image datais not completed, and further obtain specified image data first.Therefore the image data can be used efficiently.

The digital camera 1 may transfer only image data requested by theserver 5. This can greatly reduce an amount of data transferred, andalso reduce a load of image data transfer on each apparatus and eachnetwork.

FIG. 2A and FIG. 2B are perspective views of an example of externalappearance of the digital camera 1 in FIG. 1.

As shown in FIG. 2A, a front side and a top part of a casing 11 of thedigital camera 1 are for example provided with: a lens part 12 forcapturing an image of a subject; a power supply switch 13 for turning onand off main power supply by operation of a user; a shutter button 14for giving an instruction to start a process of capturing the image ofthe subject; a mode setting knob 15 operated by the user to input aninstruction for setting a photographing condition, selecting a functionto be used, and the like; an antenna 16 for transmitting and receivingimage data and other data; a strobe 17 for irradiating the subject withfill light; and an optical finder 18A used by the user to check an imagepickup range at the time of image pickup.

In addition, as shown in FIG. 2B, a back side of the casing 11 has: anoptical finder 18B, which is a side of the optical finder 18A which sideis viewed by the user; and an LCD (Liquid Crystal Display) 19 serving asa display unit for displaying an image obtained by picking up an imageof a subject.

FIG. 3 is a block diagram showing an example of internal configurationof the digital camera 1 in FIG. 1.

Light from a subject not shown in the figure enters a CCD (ChargeCoupled Device) 31 via the lens part 12 formed by lenses, a diaphragmmechanism and the like to be subjected to photoelectric conversion.

An image signal output by the CCD 31 is supplied to a CDS circuit(Correlated Double Sampling circuit) 32. The CDS circuit 32 subjects theinput signal to correlated double sampling to thereby remove a noisecomponent, and then outputs the signal to an AGC circuit (Automatic GainControl circuit) 33. The AGC circuit 33 adjusts a gain of the inputsignal, and thereafter outputs the signal to an A/D (Analog/Digital)converter 34. The A/D converter 34 converts the input analog signal intoa digital signal, and then outputs the digital signal to a DSP (DigitalSignal Processor) 35.

The DSP 35 generates a control signal used for AF (Auto Focus), AE (AutoExposure), and AWB (Auto White Balance) on the basis of the input signalby an image adjustment processing unit 41 included in the DSP 35, andthen supplies the control signal to a CPU (Central Processing Unit) 51via a bus 50. Also, the DSP 35 generates compressed image data by animage compression and decompression processing unit 43 included in theDSP 35 by compressing the input image data by a predeterminedcompression and decompression system such for example as a JPEG (JointPhotographic Expert Group) system while temporarily retaining an imagesignal in an SDRAM 36 controlled by an SDRAM (Synchronous Dynamic RandomAccess Memory) controller 42 included in the DSP 35. In addition, theDSP 35 generates thumbnail image data corresponding to the image data,and adds the thumbnail image data to the corresponding compressed imagedata. Further, the DSP 35 can decompress compressed image data suppliedfrom a storage unit 55 or the like by the image compression anddecompression processing unit 43 included in the DSP 35.

The compressed image data generated by the image compression anddecompression processing unit 43 is supplied to a RAM (Random AccessMemory) 53 or the like via the bus 50 to be retained. The compressedimage data is thereafter supplied to the storage unit 55 to be recordedin a semiconductor memory, a hard disk or the like, supplied to a memorycard 61 connected to a memory I/F 59 to be recorded in the memory card61, or supplied to a radio communication unit 58 to be transferred toanother apparatus. It is to be noted that when the compressed image datais transferred to another apparatus via the radio communication unit 58,thumbnail image data attached to the compressed image data istransferred first.

The CPU 51 controls various parts and performs various processesaccording to a program stored in a ROM (Read Only Memory) 52 or aprogram loaded from the storage unit 55 formed by a flash memory or thelike into the RAM 53. The RAM 53 also stores for example data necessaryfor the CPU 51 to perform various processes as required.

The CPU 51 is connected with an external operating input unit 54 forreceiving an operation by the user. The external operating input unit 54includes the power supply switch 13, the shutter button 14, the modesetting knob 15 and the like as described above, as well as variousbuttons, dials, knobs, and a touch panel (none of the buttons are shown)and the like. The external operating input unit 54 is operated by theuser, thereby receives an instruction from the user, and then suppliesthe instruction information to the CPU 51. The CPU 51 performs variousprocesses on the basis of the instruction information.

The CPU 51, the ROM 52, and the RAM 53 are interconnected via the bus50. The bus 50 is also connected with the storage unit 35 formed by anonvolatile semiconductor memory, a hard disk or the like, a displaycontrol unit 56 for controlling an image displayed on the LCD 19, thememory I/F (InterFace) 59 in which the memory card 61 or the like ismounted, and the radio communication unit 58 that performs radiocommunication with the base station 2 and is for example controlled bythe CPU 51 to supply thumbnail image data, compressed image data and thelike stored in the storage unit 55 to the server 5 via the network 3.

The display control unit 56 includes a VRAM (Video Random Access Memory)not shown in the figure. The display control unit 56 stores image datadecompressed by the DSP 35 in the VRAM included in the display controlunit 56. The display control unit 56 displays on the LCD 19 an imagecorresponding to the image data stored in the VRAM or an imagecorresponding to image data stored in another memory (the RAM 53, thestorage unit 55, the memory card 61 connected to the memory I/F 59 orthe like).

The bus 50 is also connected with a drive 63 via an interface not shownin the figure as required. A computer program read from a magnetic disk64, an optical disk 65, a magneto-optical disk 66, a semiconductormemory 6i or the like mounted in the drive 63 is installed in thestorage unit 55 or the like. Also, a computer program read from thememory card 61 mounted in the memory I/F 59 as required is installed inthe storage unit 55 or the like as required.

The CPU 51 controls operations of the CDS circuit 32, the AGC circuit33, and the A/D converter 34 on the basis of the instruction informationfrom the user which information is input by the external operating inputunit 54, the control information supplied from the image adjustmentprocessing unit 41, information obtained by performing various programs,or the like.

Also, the CPU 51 controls operation of the CCD 31 by controlling a TG(Timing Generator) 71 for controlling driving of the CCD 31 and a Vdriver 72. Further, the CPU 31 controls an iris shutter driver 73 forcontrolling operation of the lens part 12 to adjust shutter speed andadjust the diaphragm mechanism.

FIG. 4 is a diagram showing a detailed example of configuration of theradio communication unit 58 in FIG. 3.

The antenna 16 receives a radio wave from another apparatus and suppliesthe received signal to a selector 81, and supplies a signal from theselector 81 to the other apparatus by a radio wave. The selector 81demodulates the signal received from the antenna 16 by a CDMA (CodeDivision Multiple Access) system, for example, and then supplies ademodulated signal obtained as a result of the demodulation to a downconverter 82.

The down converter 82 converts frequency of a carrier of the obtaineddemodulated signal to a low frequency, and then supplies the demodulatedsignal to a reception I/F 83. The reception I/F 83 subjects the obtaineddemodulated signal to a process such as an A/D conversion process or thelike, and then supplies the digital signal to a baseband signalprocessing unit 84.

The baseband signal processing unit 84 extracts received data from thedigital signal obtained from the reception I/F 83 by performing packetprocessing, error signal processing and the like on the basis of astandard, and then supplies the received data to the bus 50. The radiocommunication unit 58 can thereby obtain a request to transfer imagedata which request is supplied from the server 5, and supply the requestto the CPU 51 and the like.

Also, the baseband signal processing unit 84 for example adds a controlsignal or the like to image data or the like obtained via the bus 50,and then supplies the result to a transmission I/F 85.

The transmission I/F 85 converts the obtained digital signal into ananalog signal, and then supplies the analog signal to a power amplifier86. A transmission signal whose power is increased by the poweramplifier 86 is output from the antenna 16 via the selector 82. Theradio communication unit 84 can thereby transfer thumbnail image dataand compressed image data obtained via the bus 50 to the server 5.

FIG. 5 is a diagram showing an example of internal configuration of theserver 5.

A CPU 111 in FIG. 5 performs various processes according to a programstored in a ROM 112 or a program loaded from a storage unit 123 into aRAM 113. The RAM 113 also stores for example data necessary for the CPU111 to perform various processes as required.

The CPU 111, the ROM 112, and the RAM 113 are interconnected via a bus114. The bus 114 is also connected with an input-output interface 120.

The input-output interface 120 is connected with: an input unit 121including a keyboard, a mouse and the like; an output unit 122 includinga display formed by a CRT (Cathode Ray Tube), an LCD (Liquid CrystalDisplay) or the like, a speaker and the like; a storage unit 123 formedby a hard disk or the like; and a communication unit 124 formed by amodem, a terminal adapter, a LAN adapter or the like.

The storage unit 123 is controlled by the CPU 111 to store thumbnailimage data supplied from the digital camera 1 via the communication unit124, and supply the thumbnail image data stored in the storage unit 123to the RAM 113, the output unit 122, the communication unit 124, thedatabase 6 and the like as required.

The communication unit 124 is connected to the networks 3 and 7. Thecommunication unit 124 is controlled by the CPU 111 to communicate withthe digital camera 1 via the network 3 and communicate with the personalcomputers 8 and 9 via the network 7.

In addition to communications using the modem, the terminal adapter orthe like, the communication unit 124 has a function of performingcommunication processes using various standards such for example as USB(Universal Serial Bus), IEEE1394 (Institute of Electrical and ElectronicEngineers), RS-232C (Recommended Standard 232 revision C), or SCSI(Small Computer System Interface).

The input-output interface 70 is also connected with the database 6 inFIG. 1, in which image data and thumbnail image data obtained from thedigital camera 1 are stored in association with each other.

When necessary, the input-output interface 70 is also connected with adrive 80, into which a magnetic disk 81, an optical disk 82, amagneto-optical disk 83, a semiconductor memory 84 or the like isinserted as required. A computer program read therefrom is installed inthe storage unit 73 as required.

When the CPU 111 obtains thumbnail image data supplied from the digitalcamera 1 via the network 3 by controlling the communication unit 124,the CPU 111 supplies the thumbnail image data to the RAM 113, thestorage unit 123 or the like to store the thumbnail image data therein,supplies the thumbnail image data to the output unit 122 to displaycorresponding thumbnail images on the display or the like, and suppliesthe thumbnail image data to the personal computer 8 or 9 via thecommunication unit 124.

Then, the CPU 111 controls the input unit 121 to receive an instructionfrom the user referring to the displayed thumbnail images, and thensupplies a request to transfer image data corresponding to the specifiedthumbnail image to the digital camera 1 via the communication unit 124on the basis of the instruction input from the user. Also, the CPU 111controls the communication unit 124 to supply a request to transferimage data which request is obtained from the personal computers 8 and 9via the communication unit 124 to the digital camera 1 via the network3.

When obtaining image data preferentially transferred via thecommunication unit 124 on the basis of the request, the CPU 111 suppliesthe obtained image data to the database 6 so as to store the image datain the database 6 in association with the thumbnail image data stored inthe RAM 113 or the storage unit 123, and displays the information on thedisplay or the like of the output unit 122. Incidentally, when therequest to transfer the image data is supplied from the personalcomputer 8 or 9, the CPU 111 controls the communication unit 124 tosupply the information to the personal computer as the source of therequest. Incidentally, the stored image data is usable to the server 5and the personal computers 8 and 9.

In addition to the storing of the data obtained from the digital camera1 in the database 6, a corresponding image may be displayed on thedisplay of the output unit 122. When the source of the request is thepersonal computer 8 or 9, the image data may be supplied to the personalcomputer as the source of the request.

FIG. 6 is a diagram showing an example of internal configuration of thepersonal computer 8.

A CPU 151 in FIG. 6 performs various processes according to a programstored in a ROM 152 or a program loaded from a storage unit 163 into aRAM 153. The RAM 153 also stores for example data necessary for the CPU151 to perform various processes as required.

The CPU 151, the ROM 152, and the RAM 153 are interconnected via a bus154. The bus 154 is also connected with an input-output interface 160.

The input-output interface 160 is connected with: an input unit 161including a keyboard, a mouse and the like; an output unit 162 includinga display formed by a CRT (Cathode Ray Tube), an LCD (Liquid CrystalDisplay) or the like, a speaker and the like; a storage unit 163 formedby a hard disk or the like; and a communication unit 164 formed by amodem, a terminal adapter, a LAN adapter or the like.

The storage unit 163 is controlled by the CPU 151 to store thumbnailimage data supplied from the server 5 via the communication unit 164,and supply the thumbnail image data stored in the storage unit 163 tothe RAM 153, the output unit 162 and the like as required.

The communication unit 164 is connected to the network 7. Thecommunication unit 164 is controlled by the CPU 151 to communicate withthe server 5 via the network 7.

In addition to communications using the modem, the terminal adapter orthe like, the communication unit 164 has a function of performingcommunication processes using various standards such for example as USB(Universal Serial Bus), IEEE1394 (Institute of Electrical and ElectronicEngineers), RS-232C (Recommended Standard 232 revision C), or SCSI(Small Computer System Interface).

When necessary, the input-output interface 160 is also connected with adrive 170, into which a magnetic disk 171, an optical disk 172, amagneto-optical disk 173, a semiconductor memory 174 or the like isinserted as required. A computer program read therefrom is installed inthe storage unit 163 as required.

When the CPU 151 obtains thumbnail image data and image data suppliedfrom the server 5 via the network 7 by controlling the communicationunit 164, the CPU 151 supplies the obtained data to the RAM 153, thestorage unit 163 or the like to store the data therein, and supplies thedata to the output unit 162 to display corresponding thumbnail images onthe display or the like.

Also, the CPU 151 controls the input unit 161 to receive an instructionfrom the user referring to the displayed thumbnail images, and thensupplies a request to transfer image data corresponding to the specifiedthumbnail image to the server 5 via the communication unit 164 on thebasis of the instruction input from the user. The server 5 supplies thisrequest to the digital camera 1 via the network 3.

When image data preferentially requested on the basis of the request istransferred to the server 5, the information is supplied from the server5. When the CPU 151 obtains the information via the communication unit164, the CPU 151 supplies the information to the output unit 162 todisplay the information on the display or the like.

Incidentally, since the configuration of the personal computer 9 in FIG.1 and the operation of each part of the personal computer 9 are similarto the configuration of the personal computer 8 and the operation ofeach part of the personal computer 8 as described with reference to FIG.6, the block diagram of FIG. 6 is applied also as an example ofconfiguration of the personal computer 9, and description thereof willbe omitted.

An image transfer process by the digital camera 1 will next be describedwith reference to a flowchart of FIG. 7.

When a user operates the power supply switch 13 to bring the powersupply into an on state, the CPU 51 of the digital camera 1 performsinitialization in step S1, and thereby initializes each part, checksoperation, and performs a preparation process, for example. Also, theCPU 51 controls the radio communication unit 58 to establish a radiocommunication with the base station 2 and be thereby connected to thenetwork 3.

After the initialization process is completed, the CPU 51 determines instep S2 whether there is thumbnail image data yet to be transmittedwhich data is retained in the RAM 53, the storage unit 55 or the like.When the CPU 51 determines that there is thumbnail image data yet to betransmitted, the CPU 31 advances the process to step S3 to perform athumbnail image data transmission process. Details of the thumbnailimage data transmission process will be described later with referenceto a flowchart of FIG. 9. When the process of step S3 is completed, theCPU 51 returns the process to step S2 to repeat the process from step S2on down.

When the CPU 51 determines in step S2 that there is no thumbnail imagedata yet to be transmitted, the CPU 51 advances the process to step S4to determine whether there is image data yet to be transmitted. When theCPU 51 determines that there is image data yet to be transmitted, theCPU 51 advances the process to step S5 to perform an image datatransmission process. Details of the image data transmission processwill be described later with reference to a flowchart of FIG. 10. Whenthe process of step S5 is completed, the CPU 51 returns the process tostep S2 to repeat the process from step S2 on down.

When the CPU 51 determines in step S4 that there is no image data yet tobe transmitted, the CPU 51 advances the process to step S6 to determinewhether an instruction to perform an image pickup process is given bythe user by controlling the external operating input unit 54. When theCPU 51 determines that a photographing mode is selected by the useroperating the mode setting knob 15, for example, and that an instructionto perform the image pickup process is given, the CPU 51 performs theimage pickup process in step S7. Details of the image pickup processwill be described later with reference to a flowchart of. FIG. 8. Whenthe image pickup process is completed, the CPU 51 advances the processto step S8.

When the CPU 51 determines in step 6 that an instruction to perform theimage pickup process is not given, the CPU 51 omits the process of stepS7, and advances the process to step S8.

The CPU 51 determines in step S8 whether to end the image, transferprocess. When the CPU 51 determines that the image transfer process isnot to be ended, the CPU 51 returns the process to step S2 to repeat theprocess from step S2 on down.

When the CPU 51 determines that the image transfer process is to beended, the CPU 51 performs an ending process in step S9, and therebyends the image transfer process.

Details of the image pickup process performed in step S7 in FIG. 7 willnext be described with reference to a flowchart of FIG. 8.

First, in step S21, the CPU 51 prepares for image pickup by controllingeach part. In step S22, the CPU 51 determines whether or not aninstruction for image pickup is given. The CPU 51 stands by until theCPU 51 determines that an instruction for image pickup is given.

When the CPU 51 controls the external operating input unit 54 anddetermines that an instruction for image pickup is given by the useroperating the shutter button 14, for example, the CPU 51 picks up animage of a subject in step S23. The CPU 51 stores image data obtained bythe image pickup in the storage unit 55 or the like in step S24. The CPU51 generates thumbnail image data in step S25. The CPU 51 then storesthe thumbnail image data in the RAM 53, the storage unit 55 or the like.

When the process of step S25 is completed, the CPU 51 ends the imagepickup process and returns the process to step S8 in FIG. 7.

Details of the thumbnail image data transmission process performed instep S3 in FIG. 7 will next be described with reference to a flowchartof FIG. 9.

First, in step S41, the CPU 51 determines whether or not an instructionto perform an image pickup process is given. When the CPU 51 determinesthat the instruction is given, the CPU 51 advances the process to stepS42 to perform the same image pickup process as described with referenceto the flowchart of FIG. 8. Then, when the image pickup process iscompleted, the CPU 51 ends the thumbnail image data transmission processand returns the process to step S2 in FIG. 7.

When the CPU 51 determines in step S41 that the instruction to performthe image pickup process is not given, the CPU 51 transmits thethumbnail image data to the server 5 via the radio communication unit 58in step S43. Then, the CPU 51 ends the thumbnail image data transmissionprocess and returns the process to step S2 in FIG. 7.

The image data transmission process performed in step S5 in FIG. 7 willnext be described with reference to a flowchart of FIG. 10.

First, in step S61, the CPU 51 determines whether an instruction toperform the image pickup process is given. When the CPU 51 determinesthat the instruction is given, the CPU 51 performs the same image pickupprocess as described with reference to the flowchart of FIG. 8 in stepS62. When the image pickup process is completed, the CPU 51 ends thethumbnail image data transmission process and returns the process tostep S2 in FIG. 7.

When the CPU 51 determines in step S61 that the instruction to performthe image pickup process is not given, the CPU 51 advances the processto step S63 to determine whether there is image data preferentiallyrequested.

When the CPU 51 obtains a preferential request supplied from the server5 via the radio communication unit 58 by a request reception process tobe described later with reference to a flowchart of FIG. 11, anddetermines that the image data is not transmitted yet, the CPU 51advances the process to step S64 to determine whether or not acompression ratio at the time of transmission is specified by thepreferential request.

When the CPU 51 determines that a compression ratio at the time oftransmission is specified, the CPU 51 advances the process to step S65,where the CPU 51 supplies preferential image data, which is therequested image data and is stored in the storage unit 55 or the like,to the DSP 35 to compress the preferential image data at the specifiedcompression ratio. Incidentally, when the preferential image data isstored in the storage unit 55 or the like in a compressed state, thecompression ratio is changed to the specified value. After compressingthe preferential image data at the specified compression ratio, the CPU51 advances the process to step S66.

When the CPU 51 determines in step S64 that a compression ratio at thetime of transmission is not specified, the CPU 51 omits the process ofstep S65, and advances the process to step S66.

In step S66, the CPU 51 controls the radio communication unit 58 totransmit the specified preferential image data to the server 5 via thenetwork. The CPU 51 sets a status of the image data to “processed”.Thereafter the CPU 51 ends the image data transmission process, andreturns the process to step S2 in FIG. 7.

When the CPU 51 determines in step S63 that there is no preferentiallyrequested image data that is yet to be transmitted, the CPU 51 advancesthe process to step S67 to determine whether or not transmission ofimage data to be transmitted next is refused by a request from theserver 5.

When the CPU 51 determines that the transmission is not refused, the CPU51 advances the process to step S68 to determine whether or not acompression ratio at the time of transmission is specified. When the CPU51 determines that a compression ratio at the time of transmission isspecified, the CPU 51 in step S69 controls the DSP 35 to compress theimage data to be transmitted at the specified compression ratio as inthe process of step S65. The CPU 51 then advances the process to stepS70.

When the CPU 51 determines in step S68 that a compression ratio at thetime of transmission is not specified, the CPU 51 omits the process ofstep S69, and advances the process to step S70.

In step S70, the CPU 51 transmits the image data to the server 5 via theradio communication unit 58. The CPU 51 sets a status of the image datato “processed.” Then, the CPU 51 ends the image data transmissionprocess, and returns the process to step S2 in FIG. 7.

When the CPU 51 determines in step S67 that the transmission of theimage data to be transmitted next is refused by the server 5, the CPU 51sets a status of the image data to “processed” in step S71. Then the CPU51 ends the image data transmission process.

As described above, the CPU 51 of the digital camera 1 controls eachpart to transmit thumbnail image data to the server 5 preferentiallybefore image data during intervals between image pickup processes.

A process of receiving a request supplied from the server 5 whichprocess is performed by the digital camera 1 will next be described withreference to a flowchart of FIG. 11.

First, in step S91, the CPU 51 controls the radio communication unit 58to determine whether or not a request is received from the server. TheCPU 51 stands by until the CPU 51 determines that a request is received.When the CPU 51 determines that a request is received, the CPU 51obtains the request, and determines whether or not corresponding imagedata is yet to be transmitted.

The CPU 51 controls each part such as the storage unit 55 or the likewhere image data is stored to refer to a status of the correspondingimage data. When the referred to status indicates “untransmitted” andthus the CPU 51 determines that the corresponding image data is yet tobe transmitted, the CPU 51 retains the request in association with theimage data in the RAM 53 or the like in step S93. This request isreferred to in for example steps S63, S64, S67, and S68 in the imagedata transmission process of FIG. 10. When the process of step S93 iscompleted, the CPU 51 advances the process to step S94.

When the CPU 51 determines in step S92 that the corresponding image datahas already been transmitted, the CPU 51 omits the process of FIG. 93,and advances the process to step S94.

The CPU 51 in step S94 determines whether or not to end the requestreception process. When the CPU 51 determines that the request receptionprocess is not to be ended, the CPU 51 returns the process to step S91to repeat the process from step S91 on down. When the CPU 51 determinesthat the request reception process is to be ended, the CPU 51 performsan ending process in step S95, and thereby ends the request receptionprocess.

As described above, the CPU 51 of the digital camera 1 receives arequest from the server 5, and controls the transfer of image data onthe basis of the request.

An image data reception process by the server 5 will next be describedwith reference to a flowchart of FIG. 12.

In step S111, the CPU 111 of the server 5 controls the communicationunit 124 to determine whether or not thumbnail image data transmittedfrom the digital camera 1 is received. When the CPU 111 determines thatthe thumbnail image data is received, the CPU 111 displays thumbnailimages corresponding to the received thumbnail image data on the displayor the like in step S112. Then the CPU 111 advances the process to stepS113.

When the CPU 111 determines in step S111 that no thumbnail image data isreceived, the CPU 111 omits the process of step S112, and advances theprocess to step S113.

In step S113, the CPU 111 controls the communication unit 124 todetermine whether or not image data transmitted from the digital camera1 is received. When the CPU 111 determines that image data transmittedfrom the digital camera 1 is received, the CPU 111 stores the receivedimage data in the database 6 in association with corresponding thumbnailimage data in step S114. Also, as described later, the CPU 111 controlsthe input unit 121 to display a mark indicating that the correspondingimage data is received on a GUI displaying the thumbnail image. When theprocess of step S114 is completed, the CPU 111 advances the process tostep S115.

When the CPU 111 determines in step S113 that no image data is received,the CPU 111 omits the process of step S114, and advances the process tostep S115.

In step S115, the CPU 111 controls the input unit 121 to determinewhether a request for the transfer of image data is input by the user.Also, the CPU 111 controls the communication unit 124 to determinewhether a request for the transfer of image data is supplied from thepersonal computer 8 or 9.

When the CPU 111 determines that a request for the transfer of imagedata is input by the user of the server 5 or that a request for thetransfer of image data is supplied from the personal computer 8 or 9,the CPU 111 in step S116 controls the communication unit 124 to supplythe request to the digital camera 1. After supplying the request, theCPU 111 supplies the process to step S117.

When the CPU 111 determines in step S115 that the request for thetransfer of image data is not input by the user or that the request forthe transfer of image data is not supplied from the personal computer 8or 9, the CPU 111 omits the process of step S116, and advances theprocess to step S117.

The CPU 111 determines in step S117 whether to end the image datareception process. When the CPU 111 determines that the image datareception process is not to be ended, the CPU 111 returns the process tostep S111 to repeat the process from step S111 on down.

When the CPU 111 determines that the image data reception process is tobe ended, the CPU 111 performs an ending process in step S118, andthereby ends the image data reception process.

As described above, the CPU 111 of the server 5 receives thumbnail imagedata and image data supplied from the digital camera 1, and transmits arequest for the transfer of image data to the digital camera 1.

FIG. 13A and FIG. 13B are schematic diagrams showing examples of a GUIscreen displayed on the display of the server 5.

When thumbnail image data is transferred first before image data, ascreen 180 as shown in FIG. 13A is displayed on the display of theserver 5. The screen 180 displays thumbnail images 181 to 186corresponding to the transferred thumbnail image data. Also, the screen180 displays an indication 187 of “IMAGES ARE BEING TRANSFERRED”indicating that thumbnail image data is being transferred.

When image data corresponding to the displayed thumbnail images istransferred, the screen 180 displays marks 181A to 183A indicating thatthe image data is transferred on the corresponding thumbnail images 181to 183, respectively, as shown in FIG. 13B.

A mark 184A indicating that image data is being transferred is displayedon the thumbnail image 184 for which the image data is beingtransferred.

When image data corresponding to the thumbnail image 186 is notnecessary, the user operates the input unit 121 to select the thumbnailimage 186 and input an instruction indicating that the transfer of theimage data corresponding to the thumbnail image 186 is not necessary. Inthis case, a request refusing the transfer of the image data is suppliedto the digital camera 1, and a mark 186A indicating that the transfer isunnecessary is displayed on the thumbnail image 186 on the screen 180.

Further, when a new image pickup process is performed by the digitalcamera 1, new thumbnail image data is transferred to the server 5. Then,thumbnail images 188 and 189 corresponding to the newly receivedthumbnail image data are displayed as newly arrived thumbnails on thescreen 180. These thumbnail images 188 and 189 may be highlighted for apredetermined time, or may be displayed in the same manner as the otherthumbnail images 181 to 186.

Incidentally, the above-described screen 180 is not only displayed onthe display of the server 5 but also displayed similarly on the personalcomputer 8 or 9 that has accessed the server 5 and is in a state forobtaining thumbnail image data.

The digital camera 1 and the server 5 operating as described aboveenable the user on the server 5 side to refer to thumbnail images beforecompletion of the transfer of image data, and have necessary image datatransferred preferentially. Therefore the user can work efficiently.

FIG. 14A and FIG. 14B are diagrams showing examples of a screendisplayed on the server 5 in a case where only image data selected bythe user of the server 5 is transferred.

When the user of the server 5 selects only necessary images fromthumbnail images displayed on the screen 180, transfer reservation marks181B, 183B, and 184B are displayed on the selected thumbnail images 181,183, and 184, respectively, as shown in FIG. 14A. The user operates atransfer button 191 to request the transfer of image data correspondingto these thumbnail images.

When the digital camera 1 starts the transfer of the requested imagedata in response to the request, various marks indicating states relatedto the transfer of the image data are displayed on the thumbnail images181, 183, and 184 on the screen 180, as shown in FIG. 14B.

When the digital camera 1 performs a new image pickup process andtransfers thumbnail image data to the server 5, thumbnail images 192 and193 corresponding to the transferred thumbnail image data are displayedon the screen 181.

While the transfer of still image data has been described above, thepresent invention is not limited to this. The transferred data may bemoving image data, which is transferred by the same process as describedabove.

When moving image data is transferred, corresponding thumbnail imagesare formed by representative images extracted from a moving image atpredetermined time intervals of for example four minutes. Specifically,in this case, five pieces of thumbnail image data are extracted frommoving image data for 20 minutes, for example, and are transferred tothe server 5 preferentially before the moving image data.

Incidentally, a method of extracting thumbnail images is not limited tothe method of extracting thumbnail images at time intervals, and may beany method. For example, when the digital camera 1 calculates adifference between images temporally adjacent to each other and adifference signal exceeds a threshold value, it is determined that ascene change occurs, and thus a thumbnail image may be extracted foreach scene. When moving image data is MPEG (Moving Picture Expert Group)data, an I-picture may be extracted as a thumbnail image.

Thumbnail images extracted from one piece of moving image data asdescribed above are displayed on a screen 200 as shown in FIG. 15A onthe server 5. The screen 200 displays: thumbnail images 201-1 to 201-5extracted from a first moving image file 201; thumbnail images 202-1 to202-5 extracted from a second moving image file 202; and a transferbutton 203 operated by the user to transfer a selected moving imagefile.

When the user selects a moving image file and then operates the transferbutton 203, the request information is supplied to the digital camera 1,and transfer of the moving image file is started. At this time, thescreen 200 is displayed as shown in FIG. 15B. In FIG. 15B, an anchor 204is displayed at the first moving image file 201 selected by the user,and marks 201-1A to 201-3A indicating that transfer is completed aredisplayed in the thumbnail images 201-1 to 201-3, respectively,corresponding to parts of the first moving image file 201 which partshave been transferred.

Then, when the digital camera 1 performs a new image pickup process andgenerates a new moving image file, thumbnail image data of the movingimage file is supplied to the server 5, and pieces 205-1 to 205-5 of thethumbnail image data of the third moving image file 205 are displayed onthe screen 200 as shown in FIG. 16.

As described above, thumbnail moving image data can be transferredpreferentially even in the case of transferring moving image data.

While the above description has been made of the preferential transferof thumbnail image data before image data, the preferential transfer isnot limited to thumbnail image data, and information on image data maybe transmitted simultaneously with thumbnail image data.

FIG. 17A and FIG. 17B are diagrams showing an example of a format ofJPEG image data.

As shown in FIG. 17A, image information 211 as information on image dataand thumbnail image data 212 corresponding to the image data areincluded in a header part of the JPEG image data 210, and compressedimage data 213 as image data that has been compressed is stored in adata part of the JPEG image data 210.

As shown in FIG. 17B, the image information 211 includes variousinformation on the compressed image data 213, such as a file name 211, afile size 211B, a photographing time 211C, a photometric system 211D andthe like.

The digital camera 1 transfers the thumbnail image data to which thisimage information is added, whereby the server 5 can display theinformation on the image data before the transfer of the image data iscompleted. In this case, a screen 220 as shown in FIG. 18 is displayedon the display of the server 5.

The screen 220 shown in FIG. 18 displays pieces of image information221A to 224A under thumbnail images 221 to 224, respectively. Thus,referring to this information together with the thumbnail images 221 to224, the user can select necessary image data.

Incidentally, image data to be transferred may be transferred afterbeing encrypted by a predetermined protocol typified by SSL (SecureSockets Layer) and IPsec (IP Security), for example.

The server 5 may authenticate the digital camera 1 transferring imagedata by using an ID and a password distributed in advance. In this case,the digital camera. 1 supplies the ID and the password in theinitialization process at step S1 in FIG. 7, and then establishesconnection.

FIG. 19 is a timing chart of assistance in explaining a process flow ina case of transfer of image data encrypted by a first encryption systemin the image processing system of FIG. 1.

First, in step S131, the digital camera 1 supplies the ID and thepassword distributed in advance to the server 5 via the network 3. Whenobtaining the ID and the password in step S151, the server 5 in stepS152 authenticates the digital camera 1 by using the ID and the passwordobtained.

When the authentication process is completed, the server 5 supplies aresult of the authentication to the digital camera 1 in step S153. Thedigital camera 1 obtains the result of the authentication in step S132.When the digital camera 1 is authenticated, a connection between thedigital camera 1 and the server 5 is established by these processes.

Having established the connection, the digital camera 1 requests apublic key provided by the server 5 from the server 5 in step S133.Incidentally, as to the public key request, a plurality of public keyscorresponding in number to that of pieces of image data to betransmitted thereafter may be requested. In this case, as laterdescribed, the server 5 needs to have secret keys corresponding to theplurality of public keys. Obtaining the request in step S154, the server5 supplies the requested public key to the digital camera 1 in stepS155. The digital camera 1 obtains the public key in step S134. It is tobe noted that the server 5 retains a secret key corresponding to thepublic key. Data encrypted by this public key can be decrypted by onlythe corresponding secret key. As later described, this secret key isused for a process of decrypting encrypted image data.

Obtaining the public key, the digital camera 1 performs a process ofstep S135 at the time of transferring image data to encrypt the imagedata to be transferred using the obtained public key. Then, in stepS136, the digital camera 1 supplies the encrypted image data to theserver 5.

Obtaining the encrypted image data in step S156, the server 5 decryptsthe encrypted image data using the secret key corresponding to thesupplied public key in step S157.

Then, when ending the image data transfer process, the digital camera 1performs a process of step S137 to discard the supplied public key.

As described above, the digital camera 1 encrypts image data using thefirst encryption system, and then transfers the image data to the server5. It is thereby possible to improve secrecy in transferring image data.In addition, since the server 5 authenticates the digital camera 1 bythe ID and the password, the server 5 can obtain image data moresecurely.

FIG. 20 is a timing chart of assistance in explaining a process flow ina case of transfer of image data encrypted by a second encryption systemin the image processing system of FIG. 1.

First, in step S171, the digital camera 1 supplies the ID and thepassword distributed in advance to the server 5 via the network 3. Whenobtaining the ID and the password in step S191, the server 5 in stepS192 authenticates the digital camera 1 by using the ID and the passwordobtained.

When the authentication process is completed, the server 5 supplies aresult of the authentication to the digital camera 1 in step S193. Thedigital camera 1 obtains the result of the authentication in step S172.When the digital camera 1 is authenticated, a connection between thedigital camera 1 and the server 5 is established by these processes.

Having established the connection, the digital camera 1 requests apublic key provided by the server 5 from the server 5 in step S173.Incidentally, as to the public key request, a plurality of public keyscorresponding in number to that of pieces of image data to betransmitted thereafter may be requested. In this case, as laterdescribed, the server 5 needs to have secret keys corresponding to theplurality of public keys. Obtaining the request in step S194, the server5 supplies the requested public key to the digital camera 1 in stepS195. The digital camera 1 obtains the public key in step S174. It is tobe noted that the server 5 retains a first secret key corresponding tothe public key. Data encrypted by this public key can be decrypted byonly the corresponding first secret key.

Obtaining the public key, the digital camera 1 in step S175 generates asecond cryptographic key for encrypting picked-up image data, andencrypts the image data to be transferred using this second secret key.It is to be noted that the image data encrypted by the second secret keyis decrypted by only the second secret key. In step S176, the digitalcamera 1 encrypts the second secret key using the public key.Incidentally, the second cryptographic key may be generated as a keycorresponding to each picked-up image, or may be generated for onetransmission unit. In step S173, a plurality of public keyscorresponding in number to that of pieces of image data to betransmitted may be requested. In this case, the server 5 needs to have aplurality of first secret keys corresponding to the plurality of publickeys. By combination of these keys, it is possible to use a differentpublic key and a different second cryptographic key for each image, andthus transmit image data more securely.

Then, in step S177, the digital camera 1 preferentially supplies theencrypted second secret key to the server 5 via the network 3 togetherwith corresponding thumbnail image data before the image data encryptedby the second secret key. The server 5 in step S196 obtains theencrypted second secret key.

Obtaining the encrypted second secret key, the server 5 in step S197decrypts the encrypted second secret key using the first secret keycorresponding to the supplied public key and retained by the server 5.

When preparation for the transfer of the image data is completed by theabove-described process, the digital camera 1 in step S178 supplies theencrypted image data to the server 5. Obtaining the encrypted image datain step S198, the server 5 decrypts the encrypted image data using thedecrypted second secret key in step S199. The server 5 thereby obtainsthe image data.

Then, when ending the image data transfer process, the digital camera 1performs a process of step S179 to discard the public key supplied fromthe server 5.

As described above, the digital camera 1 encrypts image data using thesecond encryption system, and then transfers the image data to theserver 5. It is thereby possible to further improve secrecy intransferring image data. Further, by supplying the second secret keyencrypted by the obtained public key to the server 5 via the network 3together with the corresponding thumbnail image data before the imagedata encrypted by the second secret key, the user can check the imagedata to be transmitted thereafter and also decrypt the encrypted secondsecret key by the first secret key retained by the server 5. Since thekey for decrypting the encrypted image can be decrypted in advancebefore obtaining the encrypted image data, it is possible to reduce atime for the decryption process as a whole. In addition, since theserver 5 authenticates the digital camera 1 by the ID and the password,the server 5 can obtain the image data more securely.

While the above description has been made of the image processing systemshown in FIG. 1, that is, a case where the server 5 side (including thepersonal computers 8 and 9) to which image data is transferred from thedigital camera 1 uses the transferred image data, the present inventionis not limited to this. For example, the image processing system may bean image processing system as shown in FIG. 21, that is, an imageprocessing system in which a company 4 is a provider that provides imagetransfer service and a personal computer 231 as a client uses image datatransferred from a digital camera 1.

In FIG. 21, a server 5 installed in the company 4 as the provider storesthumbnail image data and image data transferred from the digital camera1 in a database 6, and manages the thumbnail image data and the imagedata.

When obtaining image data obtained by image pickup in the digital camera1, the client 231 accesses the server 5, and then obtains thumbnailimage data supplied from the digital camera 1 first before correspondingimage data as in the case of the above-described communication betweenthe digital camera 1 and the server 5.

The configuration and operation of the client 231 is the same as theconfiguration and operation of the personal computer 8 described withreference to the block diagram of FIG. 6, and the block diagram of FIG.6 can be applied to the client 231. Therefore description of theconfiguration and operation of the client 231 will be omitted.

A process flow of each apparatus in an image data transfer process ofthe image processing system shown in FIG. 21 will next be described withreference to a timing chart of FIG. 22.

First, in step S211, the digital camera 1 performs an image pickupprocess, and thereby obtains image data. Then, in step S212, the digitalcamera 1 generates thumbnail image data corresponding to the obtainedimage data, and then supplies the thumbnail image data to the server 5.In step S231, the server 5 obtains the thumbnail image data.

Obtaining the thumbnail image data, the server 5 in step S232 suppliesthe obtained thumbnail image data to the client 231 connected to theserver 5. In step S251, the client 231 obtains the thumbnail image data,and displays corresponding thumbnail images on a display. In step S252,the client 231 receives various requests from the user.

Meanwhile, after completing the transfer of the thumbnail image data,the digital camera 1 supplies the image data to the server 5 in stepS213. In step S233, the server 5 obtains the image data, and stores theimage data in the database 6.

Receiving various processes from the user by the process of step S232,the client 231 supplies the received request to the server 5 in stepS253. The server 5 obtains the request in step S234.

Receiving the request, the server 5 in step S235 obtains the image datastored in the database 6 and then supplies the image data to the client231 on the basis of the request. The client 231 obtains the image datain step S254.

The process performed as described above enables the user of the client231 to refer to thumbnail images before the transfer of the image datais completed. In addition, since the user of the client 231 can makevarious requests at the time of referring to the thumbnail images, theuser can selectively obtain the image data, and thereby reduce a loadnecessary for the transfer process.

While in the above description, the digital camera 1 transfers imagedata to the server 5, the present invention is not limited to this. Forexample, as shown in FIG. 23, the digital camera 1 may transfer imagedata to a portable telephone 242 connected via a base station 241.

In this case, the portable telephone 242 performs the same process asthe server 5. Thumbnail images corresponding to thumbnail image datatransferred preferentially before image data are displayed on a display242A provided in the portable telephone 242.

In addition to this, image data may be transferred between digitalcameras as shown in FIG. 24. In FIG. 24, image data is transferreddirectly between two digital cameras 251A and 251B that have the sameconfiguration as the digital camera 1 and perform the same operation asthe digital camera 1 without an intervention of the network 3. Also inthis case, thumbnail image data is transferred first before image data.

Further, though not shown, the digital camera 1 may have a communicationunit for performing wire communication and be connected to the network 3or an apparatus as a destination of transfer via a cable.

While in the above description, thumbnail image data is transferredpiece by piece, and whether a preferential process such as the imagepickup process or the like is performed is determined at the time oftransfer of each piece of thumbnail image data, the present invention isnot limited to this, and thumbnail image data may be transferred in anyunit. For example, a plurality of pieces of thumbnail image data beforetransfer may be transmitted en bloc in one file. Further, the fileincluding the plurality of pieces of thumbnail image data en bloc may betransmitted after being divided into predetermined sizes or apredetermined number of files.

Incidentally, when the digital camera 1 receives a request for imagedata from the server 5, the digital camera 1 may transfer the specifiedimage data preferentially even when other thumbnail image data is beingtransferred. Thereby, the user of the server 5 can select a desiredthumbnail image from thumbnail images displayed on the display andrequest the transfer of corresponding image data even while thumbnailimage data is being transferred sequentially. Also in other cases, thedigital camera 1 may be able to transfer arbitrary image datapreferentially before thumbnail image data under a predeterminedcondition.

Further, while the digital camera has been described above as a devicefor transferring image data, the present invention is not limited tothis. For example, the present invention is widely applicable toelectronic devices such as portable telephones having a camera, digitalvideo cameras having a communication function, and PDAs having a camera.

The series of processes described above can be carried out not only byhardware but also by software. When the series of processes is to becarried out by software, a program constituting the software isinstalled from a recording medium onto a computer that is incorporatedin special hardware, or for example a general-purpose personal computerthat can perform various functions by installing various programsthereon.

As shown in FIG. 3, the recording medium storing the program that isinstalled on the computer and is in a state of being executable by thecomputer is formed by a packaged medium comprising the magnetic disk 64(including flexible disks), the optical disk 65 (including CD-ROM(Compact Disc-Read Only Memory) and DVD (Digital Versatile Disc)), themagneto-optical disk 66 (including MD (Mini-Disc) (trademark)), thesemiconductor memory 67 or the like, or the recording medium is formedby the ROM 52, the storage unit 55 or the like, which stores the programtemporarily or permanently. The program is stored onto the recordingmedium via an interface such as a router, a modem or the like, using awire or wireless communication medium such as a public line network, alocal area network, the Internet, or another network, or digitalsatellite broadcasting, as required.

It is to be noted that in the present specification, the stepsdescribing the program stored on the recording medium include not onlyprocesses carried out in time series in the described order but alsoprocesses carried out in parallel or individually and not necessarily intime series.

INDUSTRIAL APPLICABILITY

As described above, according to the present invention, it is possibleto supply image data to another apparatus. In particular, it is possibleto transfer a large amount of image data to another apparatusefficiently.

1. An image processing system comprising: an image pickup device fortransferring image data obtained by picking up an image of a subject;and an image processing apparatus for obtaining the image datatransferred from said image pickup device; wherein said image pickupdevice includes: image pickup means for picking up the image of saidsubject and generating said image data; generating means for generatingrepresentative image data representing said image data generated by saidimage pickup means; and supplying means for supplying saidrepresentative image data preferentially before said image data insupplying said image data and said representative image data to saidimage processing apparatus connected via a network; and said imageprocessing apparatus includes: obtaining means for obtaining saidrepresentative image data and said image data supplied from said imagepickup device; displaying means for displaying said representative imagedata obtained by said obtaining means; and storing means for storingsaid representative image data and said image data obtained by saidobtaining means in association with each other.
 2. An image processingsystem comprising: an image pickup device for transferring image dataobtained by picking up an image of a subject; an image managingapparatus for managing said image data transferred from said imagepickup device; and an image processing apparatus for obtaining saidimage data managed by said image managing apparatus; wherein said imagepickup device includes: image pickup means for picking up the image ofsaid subject and generating said image data; generating means forgenerating representative image data representing said image datagenerated by said image pickup means; and first supplying means forsupplying said representative image data preferentially before saidimage data in supplying said image data and said representative imagedata to said image managing apparatus connected via a network; saidimage managing apparatus includes: first obtaining means for obtainingsaid representative image data and said image data supplied from saidimage pickup device; managing means for managing said representativeimage data and said image data obtained by said first obtaining means inassociation with each other; and second supplying means for supplyingsaid representative image data preferentially before said image data insupplying said image data and said representative image data to saidimage processing apparatus connected via said network; and said imageprocessing apparatus includes: second obtaining means for obtaining saidrepresentative image data and said image data supplied from said imagemanaging apparatus; displaying means for displaying said representativeimage data obtained by said second obtaining means; and storing meansfor storing said representative image data and said image data obtainedby said second obtaining means in association with each other.
 3. Animage pickup device comprising: image pickup means for picking up animage of a subject and generating image data; generating means forgenerating representative image data representing said image datagenerated by said image pickup means; and supplying means for supplyingsaid representative image data preferentially before said image data insupplying said image data and said representative image data to anotherapparatus connected via a network.
 4. The image pickup device as setforth in claim 3, wherein: when said image pickup means generates newsaid image data while said supplying means is supplying said image datato said other apparatus, said supplying means preferentially suppliesnew said representative image data representing the new said image data,the new said representative image data being generated by saidgenerating means, to said other apparatus before said image data beingsupplied.
 5. The image pickup device as set forth in claim 3, furthercomprising receiving means for receiving control information on supplyof said image data, wherein said supplying means supplies said imagedata to said other apparatus on a basis of said control informationreceived by said receiving means.
 6. The image pickup device as setforth in claim 4, wherein: said supplying means supplies relatedinformation on said image data to said other apparatus together withsaid representative image data or the new said representative imagedata.
 7. The image pickup device as set forth in claim 6, furthercomprising: receiving means for receiving a first cryptographic keysupplied by said other apparatus; cryptographic key generating means forgenerating a second cryptographic key for encrypting said image datagenerated by said image pickup means; first encrypting means forgenerating first encrypted data by encrypting said image data generatedby said image pickup means by said second cryptographic key; and secondencrypting means for generating second encrypted data by encrypting saidsecond cryptographic key by said first cryptographic key; wherein therelated information on said image data is said second encrypted data. 8.An image pickup method comprising steps of: first generating forgenerating image data obtained by picking up an image of a subject;second generating for generating representative image data representingsaid image data generated by a process of said first generating step;and supply controlling for controlling supply so as to supply saidrepresentative image data preferentially before said image data insupplying said image data and said representative image data to anotherapparatus connected via a network.
 9. The image pickup method as setforth in claim 8, wherein: when new said image data is generated by theprocess of said first generating step while said image data is beingsupplied to said other apparatus, said supply controlling step controlssaid supply so as to preferentially supply new said representative imagedata representing the new said image data, the new said representativeimage data being generated by a process of said second generating step,to said other apparatus before said image data being supplied.
 10. Theimage pickup method as set forth in claim 8, further comprising a stepof reception controlling for controlling reception of controlinformation on supply of said image data, wherein said supplycontrolling step controls said supply so as to supply said image data tosaid other apparatus on a basis of said control information received bya process of said reception controlling step.
 11. The image pickupmethod as set forth in claim 9, wherein: said supply controlling stepcontrols said supply so as to supply related information on said imagedata to said other apparatus together with said representative imagedata or the new said representative image data.
 12. The image pickupmethod as set forth in claim 11, further comprising steps of: receptioncontrolling for controlling reception of a first cryptographic keysupplied by said other apparatus; cryptographic key generating forgenerating a second cryptographic key for encrypting said image datagenerated by the process of said first generating step; first encryptingfor generating first encrypted data by encrypting said image datagenerated by the process of said first generating step by said secondcryptographic key; and second encrypting for generating second encrypteddata by encrypting said second cryptographic key by said firstcryptographic key; wherein the related information on said image data issaid second encrypted data.
 13. A recording medium on which a computerreadable program is recorded, said program comprising steps of: firstgenerating for generating image data obtained by picking up an image ofa subject; second generating for generating representative image datarepresenting said image data generated by a process of said firstgenerating step; and supply controlling for controlling supply so as tosupply said representative image data preferentially before said imagedata in supplying said image data and said representative image data toanother apparatus connected via a network.
 14. A program making acomputer perform a process comprising steps of: first generating forgenerating image data obtained by picking up an image of a subject;second generating for generating representative image data representingsaid image data generated by a process of said first generating step;and supply controlling for controlling supply so as to supply saidrepresentative image data preferentially before said image data insupplying said image data and said representative image data to anotherapparatus connected via a network.